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ABSTRACT 

Fonnulae  are  derived  for  the  number  of  digraphs  and  of  hypergraphs  with 
given  automorphism  group.  It  is  shown  that  for  «  >  2  (respectively,  n  >  3), 
there  is  no  hypergraph  (respectively,  digraph)  with  automorphism  group  A„. 
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In  this  note  we  show  some  combinatoria]  results  about  automorphism  groups  of  digraphs  and 
hypergraphs.  The  pr(*lems  arose  in  connection  with  some  issues  in  database  theory:  in  [HY]  the 
notion  of  data  base  formats  is  introduced.  It  is  shown  [OY]  that  a  natural  oanxpl  of  information 
capacity'  of  formats  is  dosely  connected  to  the  automorptosm  groups  of  instances  of  formats. 
Digraphs  (resp.  hypergraphs)  turn  out  to  be  the  instances  of  a  very  simple  format. 

For  any  positive  integer  n,  S„  is  the  permutation  group  on  {1,...,  n],  i.e.,  the  group  of  all  nl 
bijective  maps  frcwn  this  set  onto  itself.  A  digraph  (directed  graph)  on  this  set  of  vertices  may  be 
identified  with  a  set  of  ordered  pairs  of  distinct  vertices,  i.e.,  a  digraph  may  be  uniquely  defined 
by  specifying  its  directed  edges.  Again,  a  hypergraph  on  this  set  of  vcrtioes  may  be  identified  as  a 
set  of  subsets  of  the  set  of  vertices,  each  subset  being  a  'hyper-edge.'  Notice  that  a  graph  can  be 
regarded  as  a  hypergraph  in  which  each  hyperedge  has  exactly  two  vertices. 

Given  a  hypergraph  W,  if  it  is  a  permutation  of  the  vertices  such  that  for  every  hyperedge  E 
iaH,  vE  =  {irv:  v^£}  also  belongs  to  H,  then  we  call  tr  an  automorphism  of  H.  Qearly  the  set  of 
automorphisms  of  H  forms  a  subgroup  of  S„.  Similarly  one  defines  the  automorp^iism  group  of  a 
digraph  D,  based  on  the  definition  Tr(u,v)  =  ('r:u,iTv)  for  a  directed  edge  {u,v). 

A  cycU  or  cydic  permutation,  written  (ij...m)  where  i,j,..  ctceta-a  are  distinct  numbers 
from  {!,...,  n},  is  one  that  maps  i  to  ),  j  to  k,  ...  and  m  to  i,  leaving  the  other  numbers  fixed. 
Qearly,  two  disjoint  cycles  commute,  and  any  permutation  may  be  written  as  an  (essentially 
unique)  product  of  disjoint  cydes.  Since  cydes  of  length  1  have  no  effect,  we  can  always  assume 
that  all  numbers  from  1  to  n  are  represented  in  the  cyde  decomposition  of  a  permutation.  H  with 
respect  to  such  a  product  the  number  of  even-length  cydes  is  odd,  then  the  permutation  is  odd  and 
has  sign  —1;  else  it  is  even  and  has  sign  H-1.  It  is  easy  to  show  that  the  sign  of  permutations  deter- 
mines a  homomorphism  of  S„  into  the  multiplicative  group  {1,-1}.  Hence  the  set  of  even  permu- 
tations forms  a  subgroup  A„  of  S„,  the  alterruiting  group  on  n  elements. 

Given  a  permutation  a,  for  1  s  i  rs  n  let  kj{a)  be  the  number  of  cydes  of  length  i  in  the 

cyde  decomposition  of  a.  For  any  subgroup  A  of  5„,  the  Polya  cycle  index  p^^iz-^ z„)  of  A  is 

the  polynomial 
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in  indetoininates  z^.  .  .  .  ,z„,  where  #A  is  the  cardinality  (order)  of  the  subgroup  A.  FinaUy,  for 
any  subgroup  A  of  5„,  define  A  (A)  to  be  the  number  of  hypergraphs  whose  automorphism  group 
equals  or  contains  A,  and  let  d(A)  be  the  number  of  digraphs  whose  automorphism  group  equals 
or  contains  A.  (Note  that  here  digraphs  and  hypergraphs  are  labelled  structures,  i.e.,  we  distin- 
guish between  distinct  structures  even  if  they  are  isomorphic.) 

ProposWon  1.  ^A)  =  f^^-''^\ 

Proof.  A  A-orbit  is  a  hypergraph  of  the  form  {aE:  aCA}  where  £  is  some  subset  of 
{1,...,  n}.  Qearly,  a  hypergraph  has  automorphism  group  containing  A  if  said  only  if  it  is  a  union 
of  A-orbits.  HeiKe  it  is  enough  to  show  that  there  are  exactly  p^(2,2,...,2)  A-orWts.  For  any  per- 
mutation a  let  F((j)  denote  the  number  of  subsets  of  {l,...,n}  fixed  by  a.  By  Bumside's  Lemma 
[Lovasz]  the  number  of  A-orbits  is 

However,  it  is  easy  to  see  that  F(a)  =  Yl^  "  >  *"***  a  set  S  is  fixed  by  a  if  and  only  if  it  is 

/-I 

a  union  of  cydes  of  a.  Q.E.D. 

As  shown  in  [OY],  using  generating  functions  given  in  [Lovasz],  for  n^3,  pA2 2)  = 

P5  (2,. ..,2).  In  other  words,  every  hypergraph  with  at  least  three  vertices  wfaicfa  is  invariant  under 
all  even  permutations  is  invariant  under  all  permutations,  so  we  have  the  foUowing. 

Pn^mattlon  2.  For  n^3,  no  hypergraph  on  n  vertices  has  automorphism  group  A„  • 

It  is  easy  to  construa  a  digraph  whose  automorphism  group  is  A3:  namely,  a  dockwise 
oriented  triangle.  However,  for  n  ^4  the  same  result  holds  for  digraphs,  as  we  shall  see.  We  shall 
first  give  a  formula  for  J(A),  similar  to  the  formula  in  Proposition  1.  Note  that  a  pennutation  a 
fixes  a  directed  edge  («,v)  if  and  only  if  it  fixes  both  u  and  v.  Tbus  D(a)  =  k^(<7)(k^(a)-l), 
where  £)(a)  is  the  number  of  directed  edges  fixed  by  ct.  Again  using  Bumside's  Lemma,  the 
number  of  A-orbits  of  directed  edges  is  — —  2  D{(t),  so  reasoning  as  in  Proposition  1  we  have: 

PropodtJon  3.  J(A)  =  -j^S  *:(<t)(*i(ct)-1)  • 

The  formulae  established  in  Propositions  1  and  3  may  be  used  to  compute  for  each  subgroup 
of  S„  the  number  of  hypergraphs  and  digraphs  whose  automorphism  group  coincides  with  A  [OY]. 
This  can  be  accomplished  using  Mbbius  inversion  [Lovasz].  While  the  method  is  in  prindple  quite 
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general,  in  practice  it  becomes  laborious  for  n  >  4.  On  the  other  hand,  it  is  relatively  easily  to 
show  that  f or  n  >  3  no  digr^)b  can  have  automorphism  group  A„,  as  follows. 

Let  B„  be  the  set  of  odd  permutations  in  S„.  Qearly,  it  is  enough  to  show  that  d(A„)  <« 
d{S„)  if  n  >  3.  Since  #A,  =  #B„  =  i-#5„,  it  is  enough,  by  Proposition  3,  to  show  that  f or  n  >  3 

2:*i(<T)(iki(a)-l)    =     2*i(^)(Jti(«')-l) 

For  l^i^n  let  0{n,i)  (respectively,  E{n,i))  be  the  number  of  odd  (respectively,  even)  permuta- 
tions a  in  S„  such  that  k-^{a)  =  j.  Qearly,  E{n,i)  =  f'!j£(n-i,0),  with  a  similar  formula  holding 
for  the  odd  permutations,  since  every  permutation  in  5(n)  fudng  precisely  i  vertices  can  be  defined 
by  choosing  a  set  X  of  size  i  which  it  fixes  -  there  are  I"  j  such  sets  X  -  and  r^arding  the  rest  of 
the  permutation,  which  fixes  nothing,  as  a  member  of  S„_,;  note  that  both  permutations  are  odd 
or  both  are  even.  Thus  we  can  rewrite  the  above  fomula  as 

0   =    iR)(0(«-l)(O(n-/,0)-£(n-/,0))  (.) 

Thus  it  remains  to  compute,  for  each  k,  the  quantity  O{k,0)-E(k,0).  For  each  subset  Y  of  {1,..., 
n},  write  V(k,Y)  (respectively,  W(k,Y))  for  the  number  of  odd  (respectively,  even)  permutations  in 
St  which  fix  all  vertices  in  Y  (and  perhaps  others  besides).  Let  D(Jt,r)  =  Vik,Y)  -  W(k,Y).  By 
the  principle  of  indusion/exclusion  [Lovasz],  the  quantity  O(k,0)-E{k,0)  may  be  expressed  as  the 
alternating  sum 

2  i-ir'D{k,Y) 

YQ{l....Ji} 

(note  that  this  sum  is  over  all  subsets  Y,  including  the  empty  set.)  Qearly,  if  #1'  s  k-2  then 
D{k,Y)  is  zero,  since  any  even  permutation  fixing  aD  vertices  in  Y  may  be  multiplied  by  a  tran^xv 
sition  not  affecting  Y,  and  vice-versa.  For  #1'  =  Jt-1  or  Jt,  there  is  only  one  permutation  fixing 
every  vertex  in  Y  •  namely,  the  identity  permutation  -  so  D(k,Y)  =  -1.  Since  thoe  are  k  sets  of 
size  it-1  and  one  of  size  k,  the  above  formula  reduces  to  (-l)*(-l)*~^-l-(-l)(-l)*,  i.e., 
(-!)*(*-!).  Substituting  into  formula  (*),  where  we  write  n-i  for  k,  we  obtain 

i(")'('-i)(-irv-'-i) 

This  formula  can  be  rewritten,  using  some  formal  differentiation,  as 

aP{-l)+bP'i-l)+cP"{-l)-¥dP'"(-\) 

where  P{x)  -  (l+jt)",  and  a,  b,  c,  and  d  are  functions  of  n  only.  Thus,  for  n  a-  4,  the  expression 
vanishes  identically,  so  we  deduce  the  following 
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Propoahloo  4.  For  n  2  4,  no  digraph  on  n  vertices  has  automorphism  group  A„  • 

A  Gnal  remark  is  that  it  appears  that  the  above  techniques  can  be  extended  to  showing  that 
other  dasses  of  formats  [HY.OY]  also  do  not  have  the  alternating  group  A„  as  an  automorphism 
group,  for  suffideQtly  large  n. 
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